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Abstract. Let Xi,X2,--. be a sequence of independent and 
identically distributed random variables, and put Sn = Xi + ■ ■ ■ + 
Xn- Under some conditions on the positive sequence r„ and the 
positive increasing sequence a„, we give necessary and sufficient 
conditions for the convergence of J2^=i'''nP{\Sn\ > £a„) for all 
e > 0, generalizing Baum and Katz's (1965) generalization of the 
Hsu-Robbins-Erdos (1947, 1949) law of large numbers, also allow- 
ing us to characterize the convergence of the above series in the 
case where t„ — n^^ and a„ = (nlogn)^/^ for n > 2, thereby 
answering a question of Spataru. Moreover, some results for non- 
identically distributed independent random variables are obtained 
by a recent comparison inequality. Our basic method is to use a 
central limit theorem estimate of Nagaev (1965) combined with the 
Hoffman- J0rgensen inequality (1974). 



1. Introduction and main result 

Hsu and Robbins showed that if Xi, X2, . . . are independent and 
identically distributed mean zero random variables with finite variance, 
then 

(1) ^P(|5„| > en) < 00, V£>0, 

n=l 
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where Sn = Xi + ■ ■ ■ + X^. Erdos ^ then showed that a converse 
imphcation also holds, namely that if (0) holds and the {Xi} are inde- 
pendent and identically distributed, then -^[X^] < oo and -E[Xi] = 0. 
Since then, a number of extensions in several directions have been 



proved; see [|13l and for partial bibliographies and brief discussions. 

The purpose of the present paper is to prove a new and very gen- 
eral extension of the Hsu-Robbins-Erdos law of large numbers. Among 
other results, this extension will allow one to give necessary and suffi- 
cient conditions (see Corollary ^ in Section 0) for the truth of 

oo 

^n~ip(|S„,| > 6{n\ogny/^) < oo, > 0, 

n=l 

where Sn = Xi + ■ ■ ■ + X„ for independent and identically distributed 
Xi, X2, . . . , thereby answering a question of Spataru. 

Throughout, terms like "positive" and "increasing" indicate the non- 
strict varieties ( "non- negative" and "non- decreasing" , respectively). 

To state our general result, we need a definition: A positive sequence 
{r„}^^ is said to satisfy Condition A provided that for all positive 
decreasing sequences {c„}J^]^ such that ^^^^ r„ min(nc„, 1) converges, 
we likewise have X^^i '^n.nCn converging. The following Proposition 
gives us a simple sufficient criterion for Condition A. A proof will be 
given in Section Rl, below. 
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Proposition 1. Suppose that either lim inf „^oo Tn > or that both of 
the following two conditions are satisfied: 

(a) lim inf „^oo ''^Tn, > 0, and 

(b) there is a constant C G (0, oo) such that for each n G Ijq , if 
2"-i < A; < 2", then 

CT2n-l > Tfc > C "'^T2'i. 

Then, {r„} satisfies Condition A. 

We now state our main result. Conditions (@) and (|]) in the result 
below are technical conditions that will be satisfied for a wide class 
of sequences {r„} and {an}- In particular, they will automatically 
hold in the case where a„ = L{n)n°' and r„ = K{n)n^, assuming L 
and K are slowly- varying functions, a > 1/3 and liminf nr^ > (see 
Proposition below). 

Theorem 1. Let Xi,X2,... be independent identically distributed 
random variables. Put S'„ = Xi + ■ ■ ■ + Let {r^j^i be any pos- 
itive sequence of numbers, and let {an}'^=i be an increasing strictly 
positive sequence tending to oo. Furthermore, assume there exist finite 
constants 6 > 1, C > and N >2 such that for all n > N we have: 
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If9>l, then additionally assume that 



rt-l 



(3) liminf inf -4 Vjr, > 0. 

n^oo k>n kal ^ 
n j^i 

Then, if all of the following three conditions hold: 

(i) there is a sequence {fin}'^=i with fin a median of Sn for all n, such 
that for all e > 0, we have X]n6Af(e) '^n < oo, where M{e) = {n E 
Z+ : |/i„| > ean}, 

(ii) J2'^=i''^'^nP{\Xi\ > ean) < oo for all e > 0, and 

(iii) Er=i < oo for all e > 0, where Te,n = E[Xf ■ 
l{|Xi|<ea„}]; o-nd where e~*/° = for all t > 0, 

we will have: 

oo 

(4) Yl ^nP{\Sn\ > ean) < OO, Ve > 0, 

n=l 

and, conversely, if the sequence {r„} satisfies Condition A and @ 
holds, conditions (i), (ii) and (iii) will also hold. 

The proof will be given in Section 13, below. The result is closely 



related to work of Klesov [0, Theorem 4] , though we are working with 
a more general class of sequences {a„}. Our proof will be based upon 
Klesov's Hoffman- J0rgensen inequality based approach, combined with 
a central limit theorem estimate of Nagaev [|TH| , the latter being used 



rather like in 18 



The particular newness of the result is that it works for near 
the critical growth n^^"^ involved in the central limit theorem. For 
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instance, as already advertised, in Corollary ^ we will use the Theorem 
to characterize the cases where holds with r„ = n^^ and a„ = 
(nlogn)^/^ (for n >2). 

Now, recall that a measurable function on [0, oo) is slowly vary- 
ing (in the sense of Karamata) providing that for all A > we have 
lima;^oo0(Ax)/</)(x) = 1. 

Proposition 2. If K and L are strictly positive slowly varying func- 
tions on [0, oo), and if an = K{n)n°' for some « > | and Tn = L{n)n^ 
for some real (3 such that lim inf „nr„ > 0, then conditions (|^) and (^ 
will he satisfied for a sufficiently large 9. 

Sketch of proof of Proposition 0. First, for sufficiently large 6', approx- 
imate YlT=n o-k^^k^Tk by an integral and use the fact that if is slowly 
varying then t~^(f)(t) dt is asymptotic to {p — l)^^x^~^(j){x) for large 
a; if p > 1 by Karamata's integral theorem Proposition 1.5.10]. It is 
here that the condition that a > | will be used; one will also need to 
use the easy fact that powers and products of slowly varying functions 
are slowly varying. This will show via a straightforward computation 
that the left hand side of (Q) is asymptotic to Cn^^^ K{n). But also 
using an integral to approximate the right hand side of (pj) and using 
the fact that if cj) is slowly varying then f^cpit) dt is asymptotic to 
(p+ l)^^x^^^0(a;) for large x by Karamata's other integral theorem p. 
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Proposition 1.5.11] if p > —1, we can see that the right hand side of 
(1^) is also asymptotic to Cn^^^K^n), and so holds. 

Condition can be obtained by noting that K can without loss of 
generality be replaced by a normalized slowly varying function (see P, 
p. 15]) asymptotic to K, and then a|//c will be an increasing function 
for sufficiently large A; if a > 1/3, by the Bojanic-Karamata theorem p, 
Theorem 1.5.5], so that the infimum on the left hand side of will be 
attained at k = n, and the truth of (|^) will follow from the condition 
that liminf nr„ > 0. Condition A will also be satisfied by {r„} under 
the above circumstances, as is very easy to see by Proposition |l]. □ 

Remark 1. By a maximal inequality of Montgomery-Smith [|l5l, con- 
dition is equivalent to: 

oo 

^^r„P(| sup 5*^1 > ean) < oo. We > 0. 



n=l 



l<fc<n 



Remark 2. Readers familiar with Hsu-Robbins-Erdos laws of large 
numbers may be surprised at condition (iii) in Theorem |l], since nor- 
mally these laws of large numbers simply have @ equivalent to (i) 
and (ii) (under appropriate conditions on {r„} and {a„}). In gen- 
eral, condition (iii) cannot be eliminated from Theorem |I|, and seems 
to become particularly significant for a„ near the critical grown ra^/^. 
(Example |I] in Section § will show that condition (iii) cannot be elim- 
inated if Tn = and = (nlogn)^/^.) However, in a number of 
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special cases, condition (iii) can indeed be removed, as is seen in the 
following result. 

Theorem 2. Suppose the {r„} is positive and {fln} is increasing and 
strictly positive, and that there are finite real constants 9 > 1, C > 
and N > 2 such that for all n > N we have: 

k=n " k=l 

and 

(6) liminf inf — ^ ji"-; > 0. 

n^QO k>n kai 

n j=l 

Then, any random variable Xi satisfying condition (ii) of Theorem || 
automatically satisfies condition (iii) of that Theorem. 

The proof will be given in Section ^ below. Note that (|^) automat- 
ically implies (H), and (H) likewise implies (0). 

Remark 3. It is not difficult to see that if K and L are slowly varying 
strictly positive functions on [0, oo), and if a„ = K{n)n" for some 
a > I while r„ = L{n)n^ for some real f3 such that liminf„ nr„ > 0, 
then conditions (j^) and (j^) will be satisfied for a sufficiently large 6. 
Since by Proposition H, conditions @ and @ would allow a to be ^ 
(or in fact any value greater than i), this helps to further illustrate how 
condition (iii) becomes relevant close to the critical growth n^^'^ of a^. 
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but for faster growths (i.e., around n° for a > |), it can be eliminated 
by Theorem |^. 

2. Corollaries and applications 

We now obtain the following generalization due to Baum and Katz |T| 
of the Hsu-Robbins-Erdos result, thereby showing that Theorem |l] is 
indeed more general than the Hsu-Robbins-Erdos law of large numbers. 



(See [0 for a discussion of the pedigree of the Baum and Katz result.) 



Corollary 1. Suppose that Xi, X2, . . . are independent identically dis- 
tributed random variables. Let Sn = Xi + ■ ■ ■ + Fix r > 1 and 
< p < 2. Then the conjunction of the conditions 

(a) if p > I then E[Xi] = 0, and 

(b) EllXil'-P] < 00 

holds if and only if 

(7) ^ n""2p( 1 5„ I >£n^/P) < 00, V£>0. 



n=l 



Proof Let r„ = n'-^ and = n^l^ . Observe that (D, (|), (|), (D 
and Condition A all hold for appropriate choices of Q (one can use 
Proposition Q and Remark ^ here if one so desires, but in fact a direct 
verification is easy). Then by the Marcinkiewicz-Zygmund strong law 



of large numbers |T^, §16. 4. A. 3], if (a) and (b) hold, then Sn/an — > 



almost surely, hence also in probability, and therefore condition (i) of 
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Theorem ^ holds as well. Moreover, (ii) is equivalent to (b), and (ii) 
implies (iii) by Theorem ^ Thus, by Theorem 0, if (a) and (b) hold, 
(|^) follows. Conversely, if (|^) holds, then since r„ satisfies Condition A 
by Proposition [l|, it follows from Theorem |l] that (i) and (ii) (and (iii), 
but that is not needed) hold. Hence (b) holds, since it is equivalent 
to (ii). It remains to show that (a) holds. The easiest way to do this 
is to note that if p > 1 then by the Marcinkiewicz-Zygmund strong 
law of large numbers, we have {Sn — nE[Xi])/an — > almost surely, 
hence in probability, and therefore (/i„ — nE[Xi])/n^^^ 0, where 
jjj^ IS a median of Sn, and by condition (i) it will then follow that 



Recall that random variables Xi,...,X„ are said to be K-weakly 
mean dominated by a random variable X providing that for all A we 
have: 



Corollary 2. Let X be a random variable and K any finite constant. 
Let {Xk,n}i<k<n;n>i be a triangular array of random variables such 
that . . . ,Xn^n 0,^^ independent and K-weakly mean dominated by 
X for each fixed n. Let {r„,} be a positive sequence of numbers and 
let {an} be an increasing strictly positive sequence for n > 1. Put 



E[X,] = 0. 



□ 




k=l 



(see i). 
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Sn = Xi^n + ■ ■ ■ + Xn^n- Supposc that Condition (i) of Theorem 
holds, is satisfied and if 6 > 1 then holds as well. Assume that 
conditions (ii) and (iii) of Theorem |I| are satisfied with X in place of 
Xi . Then, 



n=l 



for all € > 0. 

Proof. By Theorem |l| we have 

oo 

(8) Yl ^nPil^'nl > ean) < OO, > 0, 

n=l 

where S'^ is the sum of n independent copies of X (condition (i) in this 
case will hold trivially by symmetry, while (ii) and (iii) were assumed in 
the statement of Corollary ^) One may slightly modify the comparison 
result in pO| , Corollary 1] by assuming our Theorem |l]'s condition (i) in 
place of the assumption in that paper that Sn/an — > in probability, 
which modification only very slightly affects the proof (one will need 
to use (^8|), below, after obtaining the convergence of [^, series (1.2)] 
in the original proof in pO[)- Thus modified, pO| , Corollary 1] together 
with (ID yields the conclusion of our Corollary ^. □ 

The following Corollary yielding a result similar to one of Hu, Moricz 
and Taylor P (cf. p, |10|, |lT|) can be derived from Corollary |^ exactly 



in the way that Corollary |1| was derived from Theorem 
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Corollary 3. Let X be a random variable and let K be any finite 
constant. Let {Xk^n}i<k<n;n>i be a triangidar array of random variables 
such that Xi „, . . . , X„^„ are independent K-weakly mean dominated by 
X . Let Sn = Xi^n + ■ ■ ■ + Xn,n- Fix r > 1 and < p < 2. Suppose 
E[\X\''"^] < oo. If p > 1 then assume also that E[Xn,i H — ■ + Xn^n] = 
for all n. Then, 

oo 

^n'-^P{\Sn\>en^'^), Ve > 0. 

n=l 

Now define log"*" x = log(2 + x). It is easy to see that Theorem ^ 
implies the following result. 

Corollary 4. Let Xi,X2, ... be independent and identically dis- 
tributed random variables. Then, 

oo 

(9) ^n-^ P{\Sn\ > e{n\ognf'^) <oo, Ve > 0, 

n=2 

if and only if all of the following three conditions hold: 

(a) E[X,] = 0, 

(b) E[X2/log+ |Xi|] < oo, and 

(c) Er=2 < oo for all e > where Te,„ = E[Xl ■ 

l{|Xi|<e(nlogn)i/2}]. 

The proof of the following Lemma will be given at the end of Sec- 
tion |[ 
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Lemma 1. // condition (b) of Corollary ^ holds, then {Sn — 
E[Sn]) / {n log nY^'^ ^ in probability as n — >■ oo. 

Remark 4. It is not known whether "in probabihty" can be replaced 
by "almost surely" in Lemma |1]. 

Proof of Corollary Let r„ = 1/n and a„ = (nlognY^^ for n > 2. 
Note that is easily seen to be satisfied with 6 = 1, and Condition A 
holds by Proposition Observe that (b) is equivalent to condition (ii) 
of Theorem |I| in the present setting, and that if (b) holds, then (a) is 
equivalent to (i) by Lemma |1|, so that the conjunction of conditions (a) 
and (b) of Corollary ^ is equivalent to that of conditions (i) and (ii) of 
Theorem |I[ Also, it is easy to check that (c) is equivalent to (iii), since 
the summands in the sums in both conditions are equal. □ 

Professor Aurel Spataru has asked the author whether (y) is equiv- 
alent to the conjunction of (a) and (b). This would be expected by 
analogy with other Hsu-Robbins-Erdos laws of large numbers (such as 
Corollary |l]). It is this question that has inspired the present paper. 
In light of the Corollary ^, Spataru's question is equivalent to asking 
whether the conjunction of (a) and (b) implies (c). The following coun- 
terexample that Professor Stephen Montgomery-Smith has privately 
communicated to the author shows that the answer is negative, and 
hence so is the answer to Spataru's question. 
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Example 1. Let {Km}m=o a very rapidly increasing strictly positive 
sequence, with Kq = 0. The degree of rapidity of increase will be chosen 
later so as to make the argument go. Let ip{t) = (t logt)^/^ for t > 2. 
Extend ip linearly to the interval [0,2] in such a way that ipi^) = 0- 
Let be the inverse function of ip. Assume that Ki > 2. Let Xi be 
a random variable such that P{Xi = il){Km)) = P{Xi = —il){Km)) = 
2-'"'-^ I Km for all m, and with P(|Xi| ^ {0}U{^(ir„) : m E Z+}) = 0. 
Let e = 1. We have 



oo 

i?[0(|Xi|)] = 5^2"™ir-i-ir„ = l. 

m=l 



It is easy to see that in general < oo if and only if (b) holds, 

and hence indeed (b) is satisfied in the present case. So is (a), since Xi 
is symmetric (i.e., Xi and —Xi have the same distribution) and so we 
can put fin = for all n. Now, let M{n) = max{m G : < n}. 
Then, with Ti^n as in condition (iii) of Theorem |l|, and as Km > 2 for 
all m > 2 



M{n) 

Ti,„= ^(2-'"/ir„)(V'(ir^))' 

m=l 

M{n) 

= Y,i2~^/Km){Km\0gKm) 

m=l 

M{n) 

= J2 2~"^l0gir™ > 2-^^(")logirM(n). 
m=l 
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Note that if < n < K^+i, then M(n) = m and so Ti_„ > 
2~"^ log Km- Thus, for m > 1 we have 

(10) J2 ri-'-'/^'-> E n-'-2'"/iogi^™. 

Now, for any K > 2 and m G Z^, let L{K,m) be an integer greater 
than K and sufficiently large that: 

L{K,m) oo 

(11) ^ ^-l-2™/logA' > - ^ ^-l-2™/log/s:_ 

Such an L{K,m) exists because the sum on the right hand side con- 
verges. Observe furthermore that 



(12) Yl n-'~^"'/'°^'' >C-2^"'{logK){K + iy 



-2™/ log A" 
n=K+l 

for an absolute constant C > independent of i^' > 2 and m > 0. 



Combining (|lO|)-(|r^) we see that if Km+i > L{Km,m), then we have 



Km + l 



(13) ri=K^+l 

= 2-™-iC(logir„) exp (^-2™^°^^^™ + 



log Km 

Inductively choosing the Km so that for all m we have both 
I [\og Km) ■ exp -2 — > 1, 

V log Km ) 

and Km+\ > L{Km, m), we then find by (|T3p that that 

oo oo OO 

71=2 m=l n=Km+^ m=l 

Hence Corollary ^'s condition (c) fails, and so we do have our desired 
counterexample satisfying (a), (b) but not (c), and hence by that Corol- 
lary, with inequality also failing. 
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Although the answer to Spataru's question is negative, we do have 
the result under a slightly stronger moment condition than Corollary ^'s 
condition (b). 

Corollary 5. Let X be a random variable and let K be any finite 
constant. Let {Xk,n}i<k<n\n>i be a triangular array of random variables 
such that Xi^n) ■ ■ ■ , Xn,n o,re K-weakly mean dominated by X . Assume 
that 

(a) E[Xn^i + ■ ■ ■ + X„ „] = for all n, and 



(b) E 
Then, 



X^(log+log+ \X\)^+^ 



< oo for some 5 > 0. 



oo ^ 

V -P{\Sn\ > e(n\ogny/^) < oo, Ve > 0. 

' ^ n 



n 

n=2 



Proof. Using Corollary ^ and the same methods as in Corollary ^ it 
suffices to show that if condition (b) of Corollary |^ holds, then con- 
dition (c) of Corollary | is satisfied with X in place of Xi. To show 
this, without loss of generality (rescaling X if necessary) assume e = 1. 
Note that if Ti „ = i?[X^ • l{|x|<a„}]5 where a„ = (nlogn)^/^, then 
Ti,„ < E 



X2(log+ log+ 


x\y+^' 


log+ an 


log+ 


X 




(log+log+a„)i+'5 



(14) <C ^^^"'"'^ 



< C 



(log+log+a„)i+'5 
log"*" n 



(log+log+r2)i+^' 

where 6 is as in (b), while C and C are strictly positive finite constants 
independent of n > 2 (but dependent on the value of the expectation 
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in (b)). Hence, if > 2 is sufficiently large that (log'*' log^ ?7.)^+'^ > 
2C"loglog?T, for all n> N, then we have: 

oo oo 



n=N n=N 
oo 



< n-^ exp(-(log+ log+ nY+^/C) 



n=N 
oo 



< J] n ^xp(-21oglogn) = -jr^-^ < 



oo, 



n(logn) 

by ( p^ and the choice of A^. Thus condition (c) of Corollary ^ is indeed 
satisfied with X in place of Xi. □ 

3. Proofs and auxiliary results 

Proof of Proposition |I]. If liminf r„ > and Yl^=i niin(l, nc„) < oo, 
then there are only finitely many n G Z"*" for which nc„ > 1, and hence 
Yl'^=i 'Tn.nCn must also converge since it differs from Yl'^=i '^n min(l, nc„) 
only in finitely many terms. 

It remains to show that if (a) and (b) hold, then Condition A. To do 
this, suppose Cn is a decreasing sequence such that 

oo 

(15) Tn min(l, nCn) < oo. 

n=l 

Then, using (b) we have: 

oo 

oo > r„ min(l, nc„) 

n=l 

oo 

(16) C-^2^T2^+i min(l, 2^02^+1 ) 

k=0 

00 



fc=0 
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Now, lim inf 2'^r2fc+i > by (a), and hence it follows that only finitely 
many of the min(l, 2'^'^^C2fc+i) can equal 1 (since otherwise the right 



hand side of (|T^) would be infinite), so that except for at most finitely 
many values of k, we have min(l, 2^+^C2fc+i) = 2'^'''^C2fc+i. It thus follows 
from (|16D and (b) that 

OO > - ^ / T2fc+i ■ 2 C2fe+l 

-2C^ ^ T-j+2'=+i ^ Cj+2fe+i 

fc=0 j=0 
^ oo 

n.=2 

and the proof is complete. □ 

Lemma 2. In the setting of Theorem 0, if the series {r„} satisfies 
Condition A, then condition (^) entails (i) and (ii). 

Proof. Assume holds. Fix e > and any sequence of medians /i„ 
of the Sn- Let M be as in condition (i). Then, it is easy to see that 
for n G M we have -P(|5'„| > ea„) > 1/2. The convergence of J2neM'^n 
follows immediately from this and (^), and so condition (i) holds. 
On the other hand, by (^) and the remark following the main theorem 



m 



1^, we have 

oo 

Tn min(l, nP{\Xi\ > £a„)) < oo 

n=l 

for all 6 > 0. Condition (ii) follows immediately from this together with 
the fact that {r„} satisfies Condition A while {a„} is increasing. □ 
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Lemma 3. Suppose that {r„} and {p„} are positive and that {6„} is 
increasing and strictly positive. Let X he any random variable. If there 
is a constant C G (0, oo) such that for all n >2: 

oo n— 1 

(17) biY,pk<cJ2kT„ 

k=n k=l 

then 

oo oo 

n=2 n=l 

Proof of Lemma Assume without loss of generality that bi = 0. 
Then, by Fubini's theorem and (p!?]): 

oo oo n 

J2PnE[\X\' ■ li\x\<K}] < Y.PnY.h\P{h^r < \X\ < hu) 

n=2 n=2 k=l 

oo oo 

= Y,P{bk-i < \X\<bk)biY,Pn 

k=2 n=k 

oo k—l 

<Cj2Pibk-i<\X\<bk)Y,nrn 

k=2 n=l 

oo oo 

71=1 k=n+l 
oo 

= C J]nr„P(|X| >6„). 

n=l 

□ 

Lemma 4. Suppose that {a„} and are sequences in [0,1], that 

{r„} is a positive sequence, and that r G Z+ is such that Xl^^i '^n|ctn ~ 

(3nY <00. If Yln=l '^nPn < OO, then Y.n=l ^««n < 

Proof. There is a polynomial pr{x,y) of degree r — 1 with coefficients 
depending only on r such that {x — yY = x*" — ypr{x, y). Let Cr be the 
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maximum of over [0, 1]^. Then: 

oo oo oo 

n=l n=l 71=1 

If Xl^i '^nPn converges, then it follows that Xl-^i '''nOn ^-Iso converges. 

□ 



Lemma 5. Let {r„} be a positive sequence and let be a strictly 
positive increasing sequence for n > 1. Let X be a random variable 
such that 



[18) 5;]r„nP(|X|>6„)<oo. 



n=l 

Fix V G [0, oo). Put Tk = X]n=i ^'^n- Suppose that there is a constant 
C G (0, oo) and a G [1, oo) such that: 

k=n ^ 

for all n >2, and 

(20) ^ < CT^^,, 



whenever k > n > 2. Then: 



oo 



E 

n=l 



^^[i^r-i{ix.i<M] 



Tn I ^-^^ ' I < OO 



The proof is based on methods of Klesov |T^, Proof of Theorem 4]. 

Proof Set = X ■ l{|x|<b„}- Let bo = and put t„ = 

for n > 0. Note that to = 0. Put (5„ = - t^^__^ for n > 1. For 

convenience, let Tq = 1; redefining C if necessary, we may assume that 
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( |T9|) and ( pO]) also hold for n = 1. Then, since = X]fc=i ^k, and using 
Fubini's theorem and 



n=l \ n / j.^-^ 

oo oo 

(21) =E^'^E^«(^^"'^) 



fc=l n=fc 
oo 



k=l 

Let Pfc = P{hk-i < \X\ < bk). Then, note that 



(22) h<c{h-h.i)tl-' <cPkblt' 



U4-0-1 

k ' 



where c is a finite constant depending only on 9 and such that — y^ < 
c{x — y)x^~^ whenever < y < x. Now, fix £ G Z+. Let p„ = i/b'^ for 
n = £ and put Pn = for all other n. Observe that by (pO]) we have 

oo 

(23) 6::j]p, <cT„_i, 

j=n 

for n < i and the same inequality trivially holds for n > i. 

By Lemma |^ (with t = u) and (|23|), it follows that if £ > 2 so that 
pi = 0, then then 

, CO oo 

' n=l n=2 

oo 

<C5^nr„P(|X|>6„)<oo, 

n=l 

where the finiteness of the right hand side followed from (0). Thus, 
K'^ sup lit I /b'^ < oo. Then, < Kb^/k, so that (P^) yields: 

5, < cK^-P,6^(6^/fc)^- = cir^-^^. 
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Putting this into (pi]), and recalling that Ti = 1, we see that: 



n=l \ '^n / 



oo k~l 



k=2 n=l 
oo oo 



= CcK'-' Pi + ^nr„ ^ 

\ n=l fc=n+l 

(oo 
Pi + ^nr„P(|X| > 6„) j < oo, 

by Fubini's theorem and (P^). □ 



The following version of the Hoffman- J0rgensen inequality will 
be needed for the proof of Theorem || in the case 6 > 1 and follows 



immediately from |jT3|, Lemma 2.2]. 



Lemma 6. Let be independent symmetric random vari- 

ables, and let Sn = Xi + ■ ■ ■ + X„. Then for each r G Z+ there exist 
finite constants Cr and such that for all X > we have: 

n 

P{\Sn\ > A) < a$^P(|X,| > X/{2r))+Dr[P{\Sn\ > A/(2r))r. 

k=l 

Let $ be the distribution function of a (0,1) normal random variable. 

Lemma 7. Under the global conditions of Theorem |l], suppose that 
condition (ii) is satisfied and that Xi is symmetric. Then, the following 
four conditions are equivalent: 

(a) Yln=i 'T'nP{\Sn\ > Ban) < OO for all e > 0; 
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(b) for all 7 G (0,1] and e > we have J2'^=i'''n[^ ~ 
^{'yean/ {nTe^ny^"^)] < oo, where Ts,n is as in Theorem and 
where $(t/0) = for all t > 0; 

(c) there is an s > 1 such that for all e > we have Yl'^=i'^n[^ — 
$(£a„/(nr,,„)i/2)]^ < oo; 

(d) condition (iii) of Theorem |l| holds. 

The equivalence of (a) and (b) will be the most difficult part to prove, 



and will involve a similar method of proof to that in [18|, using a central 



limit theorem estimate in the present case due to Nagaev [16|. In the 



case where > 1, we will also need the Hoffman- J0rgensen inequality 



based methods of Klesov |]12|, Proof of Theorem 4]. 



Proof of Lemma ^. Note that: 

(24) 1 - $(x) = 7r-i/2^-ie-"'/2(i _ 0{x-'')) 
as X oo. Thus: 

(25) 1 - ^(x) < Ce-"'/^ 

for all X > and an absolute constant C. 

First suppose (d) holds. Put 7' = 7/2. Then, (d) implies that: 



(26) E 



-(7'e)2a2/nTy, 



r„e ^' ^' "-/'"7'E,n < 00, 

n=l 
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for all e > 0. Observe now that as 7' < 7 < 1 and by definitfon of T^y. 

Te,n < Tsy,n + {ejanfP{\Xi\ > an) 

(27) 

< max(2T,y,„,2(£7a„)2p(|Xi| > e-i'an)). 

Then, by (|2|) and (g^): 

00 00 

n=l n=l 

(00 00 
n=l n=l 

where we use the convention that e~^/^ = 0. Now, the first sum on the 



right hand side here converges by p6| ) since 7^/4 = (7')^, while the 
second converges by the elementary inequality e~^f^ < x valid for all 
X > 0, together with condition (ii) of Theorem |I]. Hence, (d) implies 
(b). 

The implication from (b) to (c) is trivial. Suppose now that (c) 
holds. Let us^n = o-n/inTs^nY^'^. Then, 



00 



(28) 5^r„e-^^"^." <oo, 

n=l 

for all 5 > by (c) and (0). Fix e > and let 6 = e/{2sY/^. Then, 

U5,n < Ue,n and SO 

Condition (d) then follows from this together with ( P^ and (PHj). Hence 
(c) implies (d), so that we have shown that (d) ^ (b) ^ (c) ^ (d). 

All we now need to prove is the equivalence of (a) and (b). To do 
this, assume we are in the setting of Theorem |l] and that (ii) holds. Fix 
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e>0. Let Xk.a{e) = Xk-l{\x^,\<sar,}- Let Snie) = Xi_„(£:)h hX„,„(£:). 

Set An{e) = \Jl=i{Xk ^ Xk^ni^)}- Observe that Sn = Snie) except 
possibly on An{e), and that 



(29) 



n=l 



n=l 



by (ii). It follows from (|29| ) and from the equality of Sn and S'„(e) 
outside An{e) that (a) holds if and only if 



(30) 



J2^nP{\Sn{e)\ > ean) <oo, \/6> 0. 



n=l 



We now need only show that ( PU[ ) holds if and only if (b) holds, and 
we will be done. Note that T^^n = -^[(-^i,n(£^))^]- Fix 7 > to be chosen 
later as needed. Then, since all the Xk^n{e) and Sn{£) have mean zero by 
symmetry, and since Xi „(e), . . . , X„ ^(e) are identically distributed for 
a fixed n, by Nagaev's central limit theorem estimate [|I6], Theorem 3] 
we have: 



Pi\Snis)\>^ean)-2 



1 - $ 



ilJ- £,n 



< cn 



E[\X^,nie) 



for an absolute constant c < cxd. Since the left hand side never exceeds 
1, it follows further that for a (possibly different) absolute constant c. 



we have: 
(31) 

P{\Sn{e)\>^ear. 



1 -$ 



< cmin ( 1, n 



E\\X,M) 



(lean) 



Observe that if (0) holds for some 6, then it also holds for all greater 
values. We now have a quick proof if 6' = 1. For then, by (|3l| ) (with 
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7 = 1) we can see that the equivalence of (b) and (|30|) would follow as 
soon as we could show that we have 



(32) E 



131 



riTr, < OO. 



n=l 



But (^) follows from the validity of @) for ^ = 1 and from condi- 
tion (ii) of Theorem [l|, by an application of Lemma ^ with p„ = riTn/a^^, 
X = Xi, t = 3 and 6„ = ean- 

Suppose now we are working with 9 > 1, so that (0) also holds. Let 
r be an integer greater than or equal to ^. I now claim that: 

(33, g,.(.nm(l. "^ll^;3-'->l'l)J<co. V. > 0. 

Suppose for now that this has been shown. If (a) holds, then as noted 
before, (|30D does likewise. Letting = 2[1 — $(£:a„/(nT£ n)-*^/^))] and 
Pn = -P(|'S'n(^)| > £CLn), wc scc that by (|30D together with (|33D and 
( Pip (with 7 = 1), we do have the conditions of Lemma ^ satisfied, so 
that Yl'^=i '^ndn < oo, and hence (c) follows, whence (b) follows by the 
already proved equivalence of (b), (c) and (d). 

Conversely, suppose (b) holds. This time letting /3„ = 2[1 — 
$(7£:a„/(nTe_„y/^))] and = P{\S„{s)\ > 'jean), using (b), together 
with (piD, ( P^D and Lemma |, we see that Yl'^=i '^ndn < oo, i.e., 

oo 

(34) Er„[P(|^„(£)| > 7£a„)]^ < oo. 

n=l 
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Let 7 = (2r)^^. By the Hoffman- J0rgensen inequality (Lemma we 
have: 

oo 

J2rnP{\Sn{e)\ >ean) 

n=l 

oo oo 

< CrY,^nP{\Xn{e)\ > 7£a„) + r„ [P( 1 | > jea^)Y . 

n=l n=l 

It is easy to see that the first sum on the right hand side is no greater 
than TnP{An{'ye)), which converges by (|^), and the second con- 

verges by (p^. Hence, (|30|) follows, and as already shown this implies 
(a). 

Hence, all we need to show is that (^) holds. Changing finitely 
many values of a„ and r„, we may assume that @ holds for all n > 2, 
and that (0) gives: 



(35) sup -^<C'J2 

k>n Ofc k=l 

for all n > 2 and a finite C. We can now apply Lemma ^ with u = 3, 
bn = ean, and X = Xi, using the assumed condition (ii) of Theorem ^ 
to guarantee (|T^) , and getting (|19D and (|^) (with an appropriately 
chosen constant) from (^ and (|35|) (which hold for all n > 2 by as- 
sumption), respectively. The Lemma then yields ( p3D since r > 6 > 1, 
and the proof is complete. □ 

Proof of Theorem^. Let ai,a2,--- be a sequence of independent 
Bernoulli random variables with P{an = 1) = P^Qn = —1) = |, and 
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with the sequence independent of {Xn}'i^=i. Let = anXn, and put 
S'^ = X[ + ■ ■ ■ + X'^. Note that the primed variables are symmetric. 

Suppose first that holds and {r„} satisfies Condition A. By 
Lemma |^ we have (i) and (ii) holding. It remains to show that (iii) 
holds. But, if (H) holds, it likewise holds with S'^ in place of Sn, as can 
be seen by conditioning on the {afc}^^ and using |]15|, Corollary 5]. But 
then by the implication (a) =^ (d) of Lemma |^ applied to the primed 
variables (which are symmetric) it follows that (iii) holds with X[ in 
place of Xi. But (iii) holding for X[ is equivalent to it holding for Xi, 
and so (iii) follows. 

Conversely, suppose (i), (ii) and (iii) hold. Evidently (ii) and (iii) will 
also hold with X[ in place of Xi. Hence by the implication (d) =^ (a) 
of Lemma ^ as applied to the primed variables we have 

oo 

(36) ^TnP{\S'J>ean) <oo, Ve > 0. 

n=l 

Now, for any random variable Y , let = Y — Y he the symmetriza- 
tion of Y, where Y is an independent copy of Y. We shall choose 
symmetrizations in such a way that X^,X|, . . . are independent and 
= Xf + ■ ■ ■ + X^ ior all n. Now, since 

Pi\Xt\ > A) < P(|X,| > A/2) + P(|Xfc| > A/2) 
- 2P{\2Xk\ > A) = 2P(|2X^| > A), 
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for all A > 0, it follows from pO|, Theorem 1] that there is an absolute 
constant c > such that 

PiK\ > A) < cP{\2S'J > A/c) 

for all A > 0. By (|6|) it then follows that 

oo 

J2^nP{\S'J>ear,)<^, ye>0. 

n=l 

By standard symmetrization inequalities [|1^, §17.1. A] it follows that 



(37) ^nP{\Sn - yUnl > ^On) < OO, Ve > 0, 
n=l 

where Hn is the median of S'„ occurring in (i). Now, for any e > we 
have 

oo 

(38) 5^r„P(|5„| >£a„) 



n=l 



- ^"^d*^" - /^n| > ean/2) + ^ r„ ■ l{|^„|>ea„/2}- 

n=l ra=l 



By condition (i), the second sum converges, and by (|37|) , so does the 
first, and hence (H) follows. □ 

Proof of Theorem 0. Assume condition (ii) of Theorem ^ holds. Fix 
e > 0. Changing a finite number of values of r„ and a„ and using (^ 
and (P) will let us assume that if we let 6„ = £:a„ and u = 2, then 
conditions (|l^) and (|20D of Lemma § will be verified for an appropriate 



constant. Applying that Lemma and using condition (ii) of Theorem ^ 
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shows that: 

oo 

(39) ^ Tnna~'^Te,n < oo, 

n=l 

where n is as in Theorem 0(iii). Now, using the elementary inequal- 
ity e~^/^ < Cgx^ which is valid for all x > where cq is a constant 



depending only on 6* > 0, we see that p9| ) entails that 

oo 
n=l 

and so (iii) is true. □ 



Proof of Lemma |l]. Let a„ = (nlogri)^/^ for n >2. Assume the condi- 
tions of the Lemma hold. Without loss of generality -E[Xi] = 0. Let 
Yn = Xi ■ l{|Xi|<a„}- Observe that Condition (b) of Corollary ^ implies 
that 

oo 

(40) ^P(|Xi| >a„) <oo. 

n=2 

We now need the fact that in order to prove that Sn/dn in 
probability, given the fact that the are identically distributed and 
with mean zero, all we need to show is that (|40|) holds as well as that 

(41) Um!^^0 

and 

(42) hm ^ ^ 0. 

n^oo a„ 

To see this fact, let ^n,k = X^/an and m„fc = in the setting of P, 
p. 105] (there run^k is supposed to be a median of ^n,k, but the proof 
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in the direction we need does not use this fact), and note that (|40|)- 



(42) together with the assumption that = (which assumption 

imphes that E[Xi ■ l{|Xi|>i] = and the proof in p. 106] yield 

the convergence in probabihty of {Sn — nE[Yn])/an to zero, which in 
turn imphes the convergence in probabihty of Sn/dn to zero by (0). 

Since as aheady noted. Condition (b) of Corollary || imphes (^0]), we 
need only prove (ETI) and (02|). First, observe that for n > 2 we have: 



(43) 



Let 



21 



(logn)-^E[Xi^-l||x,|<M] 



E 



Xl l{|x,|<a„}-l0g+Xi 



log Xl log n 



Observe that 



_ Xl _ l{|Xi|<a„} -log^^l 

log^ Xl log n 



v2 

< W„ < C: ^ 



log+Xi 

where c = sup„>2(loS^ '^n)/(log^) < But Xf/\og^Xi is in L^, 
while Wn pointwise as n — >■ oo, so that by dominated convergence 
it follows that -EfVTn] — > as n — > oo and hence ( ^T]) follows from (^31). 

Now, to prove (g^), let Un = Xi Observe that E[Un] = -E[Yn] 
since -E[Xi] = 0. Hence, we only need to show that a~^nE[Un] —>■ 0. 
Now, since |f/„| > a„ whenever Un ^ and as log^ a; is decreasing in 
a; > 0, we have (using the convention that (0^/ log^ |0|) • (log^ |0|)/|0| = 
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0): 

a-'nE[\Un\] = a-'nE[{U'J log"- |f/J) ■ (log+ |f/„|)/|f/„|] 
< a-'nE[{U^J \og+ ■ (log+ a„)/a„] 
= (log+ an)na-^E[{U^/ log+ f/„)] 0, 
since (log"*" a„)na~^ is bounded while log'*' f/„)] by dom- 

inated convergence, as almost surely and [/^/log^f/„ < 

X2/log+Xi, while Xf/log+Xi G by Condition (b) of Corol- 
lary |. □ 
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